Skip to content

Speed up documentation deployments#804

Merged
rapids-bot[bot] merged 7 commits into
rapidsai:mainfrom
bdice:perf/faster-docs-deploy
Jul 2, 2026
Merged

Speed up documentation deployments#804
rapids-bot[bot] merged 7 commits into
rapidsai:mainfrom
bdice:perf/faster-docs-deploy

Conversation

@bdice

@bdice bdice commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Summary

Speeds up CI docs builds from a median 32m04s to 8m39s (3.7x).

  • download up to four independent documentation prefixes from S3 concurrently
  • customize HTML files with a process pool sized to the CPUs available to the job
  • replace repeated full-document CSS selector scans with one consolidated document inspection
  • reduce post-processing output to periodic progress updates while retaining warnings
  • preserve the existing html5lib parser and byte-for-byte serialized output

Closes #448.

Validation

  • verified optimized HTML output is byte-identical to the original serial implementation
  • verified a second customization pass remains byte-idempotent
  • verified the S3 scheduler never exceeds four concurrent prefixes
  • verified a failed background S3 copy fails the overall script
  • ran pre-commit run --all-files

@netlify

netlify Bot commented Jul 2, 2026

Copy link
Copy Markdown

Deploy Preview for docs-rapids-ai ready!

Built without sensitive environment variables

Name Link
🔨 Latest commit d0be178
🔍 Latest deploy log https://app.netlify.com/projects/docs-rapids-ai/deploys/6a45c57fe2cb16000826e5ab
😎 Deploy Preview https://deploy-preview-804--docs-rapids-ai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@bdice bdice marked this pull request as ready for review July 2, 2026 02:09
@bdice bdice requested a review from a team as a code owner July 2, 2026 02:09
@jameslamb

Copy link
Copy Markdown
Member

/merge

@rapids-bot rapids-bot Bot merged commit 7d7b765 into rapidsai:main Jul 2, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEA] Parallelize documentation post-processing

2 participants